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Abstract — Lattice reduction-aided decoding features reduced 
decoding complexity and near-optimum performance in multi- 
input multi-output communications. In this paper, a quantitative 
analysis of lattice reduction-aided decoding is presented. To this 
aim, the proximity factors are defined to measure the worst-case 
, losses in distances relative to closest point search (in an infinite 
lattice). Upper bounds on the proximity factors are derived, 
which are functions of the dimension n of the lattice alone. The 
study is then extended to the dual-basis reduction. It is found that 
the bounds for dual basis reduction may be smaller. Reasonably 
good bounds are derived in many cases. The constant bounds 
on proximity factors not only imply the same diversity order in 
fading channels, but also relate the error probabilities of (infinite) 
lattice decoding and lattice reduction-aided decoding. 

I Index Terms — coding bounds, dual basis, lattice decoding, 
lattice reduction, minimum distance, multi-input multi-output 
communications. 

EDICS: MSP-CODR or SPC-PERF 

! I. Introduction 

The linear multi-input multi-output (MIMO) model covers 
a range of problems in communications, such as code-division 
multiple access (CDMA), inter-symbol interference (ISI) chan- 

■ nels, linearly precoded orthogonal frequency-division multi- 
I plexing (OFDM), multi-antenna fading channels with or with- 

■ out linear encoding, multi-antenna broadcast, and cooperative 
diversity [l]-[4]. For moderate to large problem sizes, (near- 
)optimum decoding for MIMO systems represents a challeng- 

I ing problem in communication theory. The naive exhaustive 

■ search for maximum-likelihood (ML) decoding suffers from 
exponential complexity. Suboptimum strategies such as zero- 
forcing (ZF) and successive interference cancelation (SIC) 

[ sometimes incurs heavy performance loss. During the past 
' decades, several improved strategies have been developed, es- 
pecially in the context of multiuser detection and equalization. 
Sequential decoding [5], branch-and-bound search [6], and 
semidefinite relaxation [7] represent the state-of-the-art. 

The theory of lattices is a powerful, distinctive approach to 
fast MIMO decoding [8]-[10]. In digital communications, the 
signal constellation or codebook is often drawn from a lattice, 
especially as the spectrally efficient high-order quadrature 
amplitude modulation (QAM) is increasingly used. Lattice 
decoding exploits the structure of a lattice to significantly 
reduce the decoding complexity. Decoding corresponds to the 
closest vector problem (CVP) for a lattice. In general, solving 
the CVP may consist of two stages: lattice reduction and a 
local search usually implemented by sphere decoding. While 
sphere decoding dramatically lowers the decoding complexity 

C. Ling is with the Department of Electrical and Electronic Engineering, 
Imperial College London, London SW7 2AZ, United Kingdom (e-mail: 
cling@ieee.org). 



at high signal-to-noise ratio (SNR) [11], it could be compu- 
tationally intensive at low to moderate SNR's. Furthermore, 
it is known that its complexity grows exponentially with the 
system size n for any fixed SNR [12]. Thus, to further widen 
the decoding speed bottleneck, some performance has to be 
traded for complexity, i.e., the CVP needs to be solved approx- 
imately. The problem of solving CVP approximately was first 
addressed by Babai in [13], which in essence applies ZF or 
SIC on a reduced lattice. This technique of approximate lattice 
decoding is referred to as lattice-reduction-aided decoding 
in communications literature [14], [15], where the expense 
associated with lattice reduction can be shared if the channel 
matrix keeps constant during a frame of data. 

Contributions of this paper: This paper presents a quantita- 
tive understanding of approximate lattice decoding. More pre- 
cisely, we shall develop a systematic approach to characterize 
its performance in terms of proximity factors, i.e., the worst- 
case loss in distances relative to (infinite) lattice decoding, 
which relates the probabilities of (infinite) lattice decoding 
and approximate lattice decoding. This approach is justified 
by the fact that lattice decoding often ignores the boundary of 
finite signals to reduce decoding complexity [16], [17]. In this 
paper, the proximity factors are found to be bounded above by 
a function of the dimension of the lattice alone. In other words, 
the output of approximate lattice decoding is in proximity 
to that of lattice decoding. As an alternative to reducing the 
primal basis, one can reduce the dual basis. This technique 
has received less attention thus far. In this paper, we find that 
in some cases dual basis reduction results in a smaller upper 
bound on the proximity factor The derived bounds serve two 
purposes: one is to bound the performance in its own right, 
the other is to give insights into approximate lattice decoding. 
The bounds apply to both fixed and random channels, and hold 
irrespective of fading statistics. 

Relations to prior works: A quantitative analysis was first 
given by Yao and Wornell [14], who showed that the loss is not 
greater than 3 dB for 2-dimensional complex Gauss reduction. 
Our idea of quantifying the performance losses using constant 
bounds in the general case started in [18] which used the 
LLL reduction in differential lattice decoding. This technique 
has been subsequently developed and improved in a series of 
conference papers [19]-[21], eventually leading to the current 
paper 

Independently, the full receive diversity of Lenstra, Lenstra 
and Lovasz (LLL) reduction in uncoded MIMO fading chan- 
nels was shown in [22], [23] by using different approaches. It 
was further shown in [17] that, remarkably, minimum mean- 
square error (MMSE) based lattice-reduction aided decoding 
achieves the optimal diversity and multiplexing tradeoff. We 
would like to point out that the diversity order derived in those 
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papers does not fully characterize the error performance, as 
the SNR gap could be arbitrary for the same diversity order 
Therefore, proximity factors offer an approach to performance 
analysis complementary to [17], [22], [23] and could deepen 
our understanding about approximate lattice decoding. The 
derivations in those papers made use of the orthogonality 
defect of a lattice, which could also be used to derive upper 
bounds on proximity factors. However, the bounds derived in 
this paper are better. 

Our analysis cannot capture the boundary effect associated 
with lattice decoding. The limitation of lattice decoding ignor- 
ing the boundary was pointed out in [24]. Yet it was shown 
in [16], [17] that the limitation is due to the naive imple- 
mentation of lattice decoding. With MMSE preprocessing, the 
performance loss relative to ML decoding is insignificant, and 
in fact lattice decoding achieves the optimum diversity and 
multiplexing tradeoff [16], [17]. 

Organization: The rest of the paper is organized as follows. 
Section II describes the system model. Section III presents the 
basics of lattices and lattice reduction that are essential to the 
subsequent development of the theory in this paper. In Section 
IV, we define the proximity factors of lattice-reduction-aided 
decoding and show the main results. In Sections V and VI, we 
derive the proximity factors for reducing the primal and dual 
basis, respectively. Section VII presents numerical results and 
then ends with a discussion. 

Notation: Matrices and column vectors are denoted by 
upper and lowercase boldface letters (unless otherwise stated), 
and the transpose, inverse, pseudoinverse of a matrix B 
by B^, B~^, and B^, respectively. For convenience, write 
B-"^ = (B-i)^ and Bt^ = (Bt)^. The inner product in 
the Euclidean space between vectors u and v is defined as 
(u,v) = u-^v, and the Euclidean length ||u|| — y/ (u, u). 

II. MIMO Decoding 

We consider a real-valued system model. For complex- 
valued system, an equivalent real system model with a doubled 
dimension is used. Reduction of complex lattices without using 
the equivalent real model is a topic that has been investigated 
elsewhere [25]. Let x — {xi, Xn)^ be the nxl data vector, 
where each symbol Xi is chosen from a finite subset of the 
integer set Z. With proper scaling and shifting [15], one has 
the generic mxn MIMO system model 

y = Bx + n (1) 

where m > n, y, n € M™ denote the channel output and noise 
vectors, respectively, and B e M'"^" is the mxn full column- 
rank matrix. The entries of n are i.i.d. normal with zero mean 
and variance <j^. The expression of matrix B depends on the 
problem at hand. For example, B is the channel matrix for 
uncoded MIMO systems; B is composed of the channel matrix 
and the generating matrix of the encoding lattice for space- 
time block codes [2]; B involves the product-channel matrix 
for cooperative communications [4]. 

For such a system model, the ML decoder is given by 

X = argmin ||y — Bx|p (2) 

where C stands for the transmitter finite set. Note that the 
complexity of the standard ML decoding that uses exhaustive 



search is exponential in n, and also increases with the alphabet 
size. 

There are linear and nonlinear decoders with cubic com- 
plexity. In the linear ZF strategy, y is multiplied on the left 
by the pseudoinverse of B, to yield the detection rule 

x=Q{BV} (3) 

where Q(-) denotes the quantization to the nearest integer 
within the signal boundary. A well-known drawback of ZF 
is the effect of noise amplification when the channel matrix 
B is ill-conditioned. By introducing decision feedback in 
the detection process, the nonlinear SIC strategy has better 
performance. One way to do SIC is to perform the QR 
decomposition B = QR, where Q has orthogonal columns 
and R is an upper triangular matrix [26]. Multiplying ([T]l on 
the left with Qi^ we have 

y' = QV = Rx + n'. (4) 

In SIC, the last symbol Xn is estimated first as i„ = 
Qiy'jjrn.n)- Then the estimate is substituted to remove the 
interference term in yn_i when Xn-i is being estimated. The 
procedure is continued until the first symbol is detected. That 
is, we have the following recursion: 

x.^q| ^-'^^'+^''""^ | (5) 

for i = n,n — 1, 1. 

ZF and SIC may incur heavy performance loss. For exam- 
ple, in single-user uncoded MIMO fading channels, ZF and 
SIC are only able to achieve the first-order diversity in an 
n X n system [27], i.e., that of a single antenna, which is 
far below the order n achieved by ML decoding. In fact, the 
diversity order of SIC cannot be increased even with ordering 
[28]. 

The basic idea behind approximate lattice decoding is 
to use lattice reduction in conjunction with traditional low- 
complexity decoders. With lattice reduction, the basis B is 
transformed into a new basis consisting of roughly orthogonal 
vectors (this is always possible in a sense defined later) 

B' = BU (6) 

where U is a unimodular matrix, i.e., U contains only integer 
entries and the determinant det U = ±1. Indeed, we have the 
equivalent channel model 

y = B'U^x + n^BV + n, x' = U^x. 

Then conventional decoders (ZF or SIC) are applied on the 
reduced basis. For example, ZF obtains the estimation 

x' = Q{(B')V}. (7) 

This estimate is then transformed back into x = Ux'. 
Since the equivalent channel is much more likely to be 
well-conditioned, the effect of noise enhancement will be 
moderated. Note that due to the linear transform U^^, it is 
no longer easy to control the boundary; thus it is typical to 
quantize to the nearest integer ignoring the signal boundary in 
0. 

Both linear and nonlinear detectors can also be designed 
with respect to the MMSE criterion. The extension to the 
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MMSE criterion is straightforward by dealing with the aug- 
mented channel matrix [29]' 



(8) 



When applied to the augmented channel matrix, ZF and 
SIC are equivalent to the standai'd MMSE and MMSE-SIC, 
respectively. In fact, MMSE is essential for infinite lattice 
decoding to achieve the optimum diversity and multiplexing 
tradeoff for finite constellations [16], [17]. The proximity 
factors derived in this paper apply to the MMSE criterion as 
well, with the understanding that ZF is replaced by MMSE, 
and SIC replaced by MMSE-SIC. 

III. Lattices and Lattice Reduction 

A lattice in the m-dimensional embedding Euclidean space 
R"* is generated as the integer linear combination of some set 
of linearly independent vectors [30]: 



L ^ i(B) = < Xihi I e Z, i = 1, 



(9) 



where B — [bi, b„] is called the basis of L. 

A lattice L can be generated by infinitely many bases, of 
which one would like to select one that is in some sense nice or 
reduced. In many applications, it is advantageous to have the 
basis vectors as short as possible. Therefore, lattice reduction, 
the shortest vector problem (S VP) and CVP are closely related 
problems. All bases of the lattice arise by the transformation 
B' — BU, where U is a unimodular matrix. 

The dual lattice L* of a lattice L is defined as those vectors 
u, such that the inner product (u, v) e Z, for all v G L [30]. 
One might define the dual basis as B^^. In this paper, we 
follow the definition of the dual basis B* = B^^J in [31], 
where 

••• 1 
••• 1 



• • • 

is the flipping matrix, i.e., it reverses the columns of B^^ in 
the left-right direction. Under this definition, the dual basis 
satisfy 

(b„b^) =,5,,„_fc+i. (10) 

where b^. is the fc-th column of B* and 5i,k is the Kronecker 
delta. We have deti* = 1/dctL and L** = L. 

For the sake of convenience, reduction of the dual basis will 
be referred to as dual reduction. Dual reduction still results in 
a reduced basis of the primary lattice. To see this, suppose U* 
is the unimodular matrix arising from reducing the dual basis 
B*, then the corresponding reduced primary basis is given by 

B' - (Bt^JU*)t^J - BJ(U*)t^J 

Since J(U*)t"^J is also a unimodular matrix, B' must be a 
basis of the primary lattice. In approximate lattice decoding, 
we can use J(U*)^"'^J as the transformation matrix in 
whereas anything else remains the same. 

'interestingly, this formulation conveniently solves the problem of lattice 
reduction in the under-determined case m < n. 



Let A(L) be the length of the shortest vector in L. The 
Hermite constant is defined as [30] 



In 



sup ■ 



(11) 



where the supremum is taken over all lattices L of dimension 
n. Hermite showed that 7„ is bounded [30]. Mordell derived 
the inequality 7^~^ < [32]. The upper bound was 

improved by Blichfeldt [33] 



(12) 



which has an asymptotic value n/ire. Even better estimates 
are known as n goes to infinity [31]: 



n , , 0.872n , , 

h o(n) < 7„ < h o[n), n 

Zne ne 



(13) 



Moreover, the Hermite constant is known exactly for n < 8: 

71 = 1,71=4/3, 7| = 2, 7^ = 4, 
7f = 8, 76® = 64/3, 7^ = 64, 7« = 2«. 



(14) 



The theory of lattice reduction [30] started with Gauss who 
introduced the concept of a lattice and found short vectors in 2- 
dimensional lattices. Reduction for general n was proposed by 
Hermite. More manageable versions were given by Minkowski 
[34], and Korkin and Zolotarev (KZ) [35], which try to 
find short basis vectors recursively. For a Minkowski-reduced 
basis B, bi is a shortest nonzero vector in L, and b, for 
i = 2, - ■ ■ , n is the shortest vector in L such that [bi, • • • b^] 
may be extended to a basis of L. In KZ reduction, this is 
performed in the linear space orthogonal to the vectors already 
found. In 1982, Lenstra, Lenstra and Lovasz proposed the first 
polynomial time algorithm which finds a vector not longer than 
2("-i)/2 times the shortest nonzero vector. 

Both KZ and LLL reduction can be seen as possible 
generalizations of the Gauss reduction, and they can be defined 
in terms of the Gram-Schmidt orthogonalization. One can 
compute the Gram-Schmidt orthogonalization by the recursion 
[36] 



i-i 



' 



for i = 1 , . . 



(15) 



where /i 



2J 



(bi,bj)/||bj|p. Note that the Gram-Schmidt 
orthogonalization depends on the order of the basis vectors. 
In matrix notation, Gram-Schmidt orthogonalization can be 
written as B = B/x^, where B = [bi,...,b„], and /x is a 
lower-triangular matrix with unit diagonal elements. In relation 
to the QR decomposition, one has ^ = ri j /r; ^ and b^ = 
fi.i ■ Qi where is the z-th column of Q. 



A. KZ Reduction 

A basis B is said to be KZ-reduced if it satisfies the 
following conditions [31]: 

• bi is the shortest nonzero vector of L; 

• iMijI < 1/2, for I <j <i<n; 

« If L^"^^) denotes that orthogonal projection of L on 
the orthogonal complement of Mbi, then the projections 
bi — /ii,ibi of b2,...,b„ yield a KZ basis of L'^^^^K 
Equivalently, bi is a shortest vector of 
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Finding a KZ basis is polynomial-time ec 
the shortest vector. Hence, the KZ basis is i 
lattices of high dimension. When n = 2, K 
same as Gaussian reduction. 



B. LLL Reduction 

A basis is LLL reduced if [37] 
• IMjj I < 1/2, for 1 < j < « < n\ 



. ||b,||2+^2^_J|b,_i||2>^||b,_i||M 

The first clause is called size reduction, 
is known as the Lovasz condition. The 
values in the interval (1/4,1] and it is c 
(5 = 3/4 for a tradeoff between quality an^ 
well known that the standard LLL algoritl 
arithmetic operations for n x n integer bai 
we established the O(n'^logn) average tin 
valued bases whose vectors are i.i.d. stan 
which is lower than thought before. A similar result on the 
average number of iterations was obtained in [39]. 

Define (3 = l/{6 - 1/4). An LLL-reduced lattice has the 
following properties: 

. Ilbill </3("-i)/2A(L); 

• llbill < /3("-i)/4det^/"L; 

• nr=il|b.|| </3"("-^)/"detL. 

These inequalities indicate in various senses that the basis 
vectors are short. These bounds are tight in the worst case 
in the sense that there exist bases reaching the bounds. 

When n = 2 and 5 — 1, LLL reduction coincides with 
Gaussian reduction. 

IV. Proximity Factors 

In this section, we shall introduce an analytic tool for 
approximate lattice decoding. The lattice literature is usually 
concerned with the approximation factor of CVP. For instance, 
Babai proved that ZF and SIC on an LLL-reduced basis find 
the closest vector, up to a factor 1 + 2n(9/2)"/^ and 2"/^ 
(for 6 = 3/4), respectively [7]. However, such results do not 
directly translate into how close approximate lattice decoding 
is to (infinite) lattice decoding in terms of the minimum 
distance, which is more useful in digital communications. To 
determine the proximity, we examine the decision regions of 
the decoders and the associated distances. 

A. Definition 

We consider a fixed but arbitrary lattice. Since we assume 
an infinite lattice, the signal space is geometrically uniform. 
Without loss of generaUty, let the transmitted lattice point 
be X = 0. The decision regions TZ of various strategies are 
depicted in Fig. [T]for a 2-dimensional lattice. 

The Voronoi cell, corresponding to the decision region of 
(infinite) lattice decoding, is a polytope defined by 



7^L 



{y 



> 



Vv e L}, 



where the subscript LD stands for lattice decoding. Each facet 
of the Voronoi cell lies on the perpendicular bisector of the 
line connecting the origin and the Voronoi neighbor e JV, 
where Af represents the Voronoi neighborhood. 




Fig. 1. Decision regions of ZF (dotted), SIC (dash-dotted) and (infinite) 
lattice decoding (solid) and the con'esponding distances in a 2-dimensional 
lattice. 

Let LD be the Euclidean distance from point to the i-th 
facet of 7?.LD- It is easy to see from Fig.[T]that di i^o ~ l|vi||/2. 
The decision regions of both ZF and SIC are polyhedra 
with 2n facets and are symmetric with respect to the origin. 
Specifically, the ZF decision region is just the fundamental 
parallelogram 7^(B) = {Ba, \ai\ < 1/2} centered at x = 0. 
Meanwhile, the SIC decision region is a rectangle specified 
by the Gram-Schmidt vectors as {Ba, \ai\ < 1/2} [14], [18], 
[40]. 

Let di ZF and di.sic be the Euclidean distance from point 
to the i-th facet of the decision regions of ZF and SIC, 
respectively. We are concerned with a spectrum of n distances 
due to symmetry. It can be seen from Fig. [T] that the distance 
spectrum of ZF is given by 



1, n 



where di denotes the angle between and the linear space 
spanned by the other n — 1 basis vectors. In Appendix H] we 
derive a formula to calculate di from B and its Gram-Schmidt 
orthogonalization, which will be used in latter sections to 
bound di,zF- 

For SIC, the distance spectrum is given by 



1, 



1, n 



where 0j is be the angle between b, and the hyperplane 
spanned by bi, ...,bi_i. Note that ||bj|| sin0j is the distance 
between the vector point b; and the linear space spanned 
by the other n — 1 basis vectors. Since b^ only needs to be 
orthogonal to bi,...,bi_i, we must have 9i < (pi and hence 

The minimum distance ^ld — inini{(ii ld} = ^{L)/2 plays 
an important role. We are motivated to define the proximity 
factors measuring the proximity between the performance of 
(infinite) lattice decoding and approximate lattice decoding as 
follows: 

X\L) 



Pi,ZF 



Pi, SIC 



sup 



BeBRcduccd ".t,ZF 

d^ 
"ld 



sup 



= sup 

BeBRcd„cc 

= sup 



||b,||2sin2 9, 



(16) 
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where the supremum is taken over the set ^Reduced of ba- 
sis matrices satisfying a certain reduction criterion for any 
n-dimensional lattices L. Furthermore, we define pzF = 
maxi<i<„ pi^zF and psic - maxi<i<„ pisic, which quantify 
the worst-case loss of approximate lattice decoding in the 
minimum squared Euclidean distance. It is noteworthy that the 
proximity factors are not a function of any particular lattice L, 
and that without reduction they are unbounded. However, we 
shall show in the latter Sections that with lattice reduction the 
proximity factor is bounded by a constant that is a function 
of n only. 

B. Distance Properties of Dual Reduction 

By ( [Tol l, '^n-i+i of '^he dual basis is perpendicular to 
the (n — 1) -dimensional hyperplane spanned by vectors 
bi,...,bi_i, bi+i,...,b„. Furthermore, since (7r/2 — 9i) is 
the angle between bi and b*_j_,_]^, we have 

{h,Mn-^+l) = ||b:_,;+i||.||b,||.COs(V2-^.) = ||b,V,+ i||.||b, 

Therefore, the following relation holds for dual reduction: 

(17) 



1, 



It indicates that we can have large distances in ZF if the vectors 
of the dual basis are short. 

Proposition 1: Let B = B/x^ and B* = B*(/x*)^ be the 
Gram-Schmidt orthogonalization of the primal basis B and 
dual basis B*, respectively. Then 



B* = B^^J, 
= J/x^J. 



(18) 



Proof: By definition, we have that for matrix B with full 
column rank 

Bt^ = [(B^B)-iB^]^ = B(B^B)-^. 

Substituting B — B/x^, we arrive at 

Bt^ = B/x^(/xB^BAt^)-^ = B(B^B)^/x 1 = \ 

Hence the reversed dual basis can be written as 

B* = B^^J = &^fi^3. 

As JJ = I, it can be rewritten into 

B* = B^^^J J/x^J. 

Since Jfi^J is upper triangular with unit diagonal elements, 
and since the columns of B^^J are orthogonal to each other, 
this is exactly the Gram-Schmidt orthogonalization of B*. 
Therefore, we have B* = and (/i*)'^ = J^^^J. As 

J = J^, fi* = 3n^3 holds. ■ 
B* = Bt^J implies 



ibdP 



i — 1,2, n 



(19) 



where b5;,...,b* are the Gram-Schmidt vectors of the dual 
basis B*. The elegant relation ( fT9l ) was derived earlier in [31], 
[41]. The relation fi* = J/x^^J is new; it corresponds to 
flipping /j,^ with respect to the anti-diagonal. 



Meanwhile, by ( fT9] l, 



H.SIC 



2 l|t>n-i+ll 



(20) 



It shows that SIC can have large distances if the reversed dual 
basis has short Gram-Schmidt vectors. 

C. Performance Bounds for Approximate Lattice Decoding 

For each decoder, an error occurs when the noise falls 
outside of TZ. Accordingly, given the basis B, the error 
probability for vector x is given by 

Pe(B) = P(x 7^ 0|x = 0) = P(n e ^). (21) 

To keep the results general, we write SNR — cja^, where 
c is a constant depending on the problem. By the symmetry 
of the Voronoi cell (i.e., there are at least two vectors with the 
shortest length,) we have the lower bound on the conditional 
decoding error probability of (infinite) lattice decoding 
•sinf?,- = 1. 



Pe,LD(SNR,B) > 2Q 



2g 



/d^D • SNR 



(22) 



Meanwhile, the union bound on the conditional error prob- 
ability of ZF reads 



Pe,zF(SNR,B)<2^Q 

4=1 



(23) 



where the factor 2 is due to symmetry. The union bound for 
SIC admits a form similar to ( |23] ). Given the same basis matrix 
B, the conditional error probability of lattice reduction-aided 
ZF can be bounded above as 



Pe,zF(SNR,B) < 2^Q 




dlo ■ SNR 



C • Pi,ZF 

(24) 

since ^f — P^.zf • c^ld definition ( fTSI l and since Q(-) is 
a decreasing function. It is worth pointing out that while the 
distance cJld is a function of B, pi ZF is not. 
Now, combining (l22l l and (l24l) . we have 



/SNR 

Pe,ZF(SNR,B) < 5]Pe,LD ,B 

Since dZSl ) holds for any B, averaging out B we obtain 

/SNR^ 



Pe,ZF(SNR) < J2 -PeXD 
i=l 



VP*, 



ZF 



(25) 



(26) 



/SNR 



(27) 



for arbitrary SNR. In particular, 

Pe,ZF(SNR) < nPe.LD , 

V PZF 

The relations ( |26] l and ( |27] i hold irrespective of fading 
statistics, and similar relations exist for SIC. They reveal, 
in a quantitative manner, that approximate lattice decoding 
performs within a constant bound from lattice decoding. 
The mere effect on the error rate curve is a shift from 
that of lattice decoding, up to a multiplicative factor n, 
which obviously does not change the diversity order In other 
words, the diversity order is the same as that of lattice 
decoding. Therefore, existing results on the diversity order 
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TABLE II 

More Explicit But Less Tight Upper Bounds on Proximity 
Factors (n: dimension; S = 3/4 for LLL reduction) 





LLL-ZF 


LLL-SIC 


KZ-ZF 


KZ-SIC 


Primal Reduction 


(1)" 


2" 


(|)".„l+lnn 


^l + ln n 


Dual Reduction 


2" 


2" 




n2 



of lattice decoding can be extended to approximate lattice 
decoding. In particular, since lattice decoding with MMSE pre- 
processing achieves the optimal diversity-multiplexing tradeoff 
for approximately universal codes [17], approximate lattice 
decoding with MMSE pre-precessing also does. Moreover, 
since lattice decoding achieves full receive diversity in the 
uncoded V-BLAST system [22], approximate lattice decoding 
also achieves full diversity. This provides an alternative way of 
showing the diversity order of lattice-reduction aided decoding 
given in [17], [22]. 

D. Main Results 

Table U shows the main results of this paper, i.e., the bounds 
on proximity factors for reducing the primary basis and for 
reducing the dual basis. The derivations will be given in the 
following two sections. Notice that the value 4/3 is exact 
for Gaussian reduction, and could be obtained by specializing 
the bounds for LLL or KZ reduction. In the meantime, the 
bounds for LLL and KZ reduction in Table U are less explicit, 
i.e., they are expressed in the parameter /? for LLL reduction 
and in the Hermite and KZ constants for KZ reduction. To 
give the readers a feeling about the dependence of the bounds 
on n. Table shows more explicit bounds for LLL and KZ 
reduction, where the bounds are however less tight. For LLL 
reduction, the bounds on proximity factors are exponential; 
if expressed in dB, they are linear with n. It is seen that 
reducing the dual basis leads to smaller bounds in many cases. 
Namely, when the dual basis is reduced, LLL-ZF has a smaller 
base in its exponential bound, while KZ reduction results in 
polynomial bounds on proximity factors for both ZF and SIC. 
It is also interesting that, unlike primal basis reduction, LLL- 
ZF and LLL-SIC have the same bounds on proximity factors 
when the dual basis is reduced. 

V. Primal Basis Reduction 

With lattice reduction, the supremum in ( fTSI l is taken over 
the set of reduced bases of the lattice L. Consequently, the 
proximity factors will be bounded. In this Section, we shall 
derive explicit upper bounds for LLL and KZ reductions. 
The bounds are expressed in closed form and turn out to be 
functions of n only. 

A. LLL Reduction 

The derivation for LLL reduction will be done by adapting 
the techniques of the original LLL paper [37] and Babai [13]. 
While the exponential bounds in [13], [37] have the best base, 
in this subsection we will improve the bounds by a constant 
factor. 



1) SIC: 

Theorem 1: For LLL-SIC, the proximity factors are 
bounded by 



4(/3-l)- 



(28) 



Proof: From [37] one has 

\\hjf < P'-i\\hif, forl<j<i<n. (29) 

Substituting this into the representation of in Gram-Schmidt 
vectors 



(30) 



we obtain 



||b,||2< \ l + Y.r'l^j llb.lp. (31) 

Note that ( |3TI ) was also given in [37] for the special case 

Let be the set of LLL-reduced basis matrices. Since 
A(L) < ||bi|j, the loss in the i-th squared Euclidean distance 
is bounded by 

X\L) 



Pi.sic = sup 



BeiSLLL ||bj||2 



(32) 



< 1 



4(/?-l)- 



It is easy to verify that when /3 > 4/3 (which is the case 
for LLL reduction) ( l32l) is smaller than the bound 



oi-l 



P^,S1C < 

directly obtainable from [37]. Obviously, 



Psic < 1 



4(/3-l) 



(33) 



(34) 



2) ZF: The derivation for LLL-ZF needs the following 
lemma. It improves Babai's lower bound on 9i [13] and 
extends it to arbitrarily values of (5 G (1/4, 1). As recognized 
by Babai [13], the lower bound on 9i describes a geometric 
feature of an LLL-reduced basis, which is of independent 
interest. The proof is given in Appendix HIl 

Lemma 1: If B is an LLL-reduced basis of lattice L(B), 
then 



sin^ Oi > 



/3 



9(3 



1 



9/3 
4 V~ 

4(/3-l) 



8/3- 



9/3-4 



(35) 



for 1 < i < n. 

It is worth mentioning that the lower bound of Lemma [T| is 
tight. The equality is achieved when ||bj||^ = /3'^-' ||bi|p and 
fiij = — 1/2 for all 1 < j < i < n. This can be seen from 
the proof. 
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TABLE I 

Upper Bounds on Proximity Factors (n: dimension;/? = 1/(5 — 1/4), 1/4 < 5 < 1; 7j: Hermite constant; gj: KZ constant) 





Gauss-ZF 


Gauss-SIC 


LLL-ZF 


LLL-SIC 


KZ-ZF 


KZ-SIC 


Primal Reduction 


4 
3 


4 
3 


/3 z' 9/3 ^ "--^ , 8/3-4 
90-4 V 4 / 9/3-4 


1+ 4(/3-l) 


i+e;=iMI)'(I)'^«.+i 




Dual Reduction 


4 
3 


4 
3 








maxi<j<„ 7| 



Applying Lemma [T] and the trivial inequality ||bi|| > X{L) 



to 



Pi,ZF < sup 



A2(L) 1 



bgBlll II blip sin^ i 



(36) 



we obtain the following theorem: 

Theorem 2: For LLL-ZF, the proximity factors are bounded 

by 



9/3 



9/3 
4 vT 



8/3- 



9/3-4 



1 + 



1 /3'-/3 
4 ' /?- 1 



(37) 



Since the upper bound is maximized when i = 1, we have 

n-l 



PZF 



< 



13 



9/3 



91 
4 V 4 



8/3-4 
9/3-4' 



(38) 



/ \ n — 1 

This is better than the bound pzp < ( 4 ) obtained 
previously in [19]. 

B. KZ Reduction 

1) SIC: To derive the proximity factors for SIC with KZ 
reduction, we make use of the KZ constant defined in [42] as 

'IbilP 



sup 



(39) 



BeiSKz ||b„||2 

where Bkz is the set of all KZ-reduced bases of dimension n. 
The KZ constant is bounded in terms of the Hermite constant 
by [42] 

^n<lnl'J^-^'Vj}r''---l2 (40) 

for n > 2. Since ||bi|| = X{L) in a KZ-reduced lattice, we 
have 

Pn,SIC — fn- 

To obtain pi,sic for i < n, note that if B is a KZ-reduced basis 
of lattice i(B), then = [bi, ...,b/] is a KZ reduced basis 
of the sublattice Li = i(Bi). This follows from the definition 
of KZ reduction and the fact that L/ C L. Accordingly, we 
have 

Theorem 3: For KZ-SIC, the proximity factors are bounded 

by 

Pi, SIC = Ci- 

Since the KZ constant ^„ is a nondecreasing function of 
n [42], we have psic = ^n, i-e., the KZ constant exactly 
quantifies the worst-case performance loss of SIC. The KZ 
constant is exactly known for n — 2 and ri = 3:^2=4/3 and 
^3 = 3/2 [42]. It is also known that [31], [42] 

l+lnn 



which is sub-exponential. 



(41) 



2) ZF: 

Theorem 4: For KZ-ZF, the proximity factors are bounded 



by 



Pi,ZF < 



i— 1 ^ = ^ 

Proof: By (I6OI) . we have 



2 .3x2, 



(42) 



PiXf= sup ■ 2, 

bgSkz llbill^sm I 



< sup 



(43) 



Applying (l65l l yields 



/3i,zF < sup A^(L) 

BgBkz 



|bd 



n-i . 



2 /3X2, 



|bi+j-| 



Using the facts that \^{L) ^ ||bi||2 and ||bi||2 < ^j\\hjf for 
a KZ-reduced basis, we obtain (l42T i. ■ 
The maximum is attained when « = 1, and 



.7 = 1 ^ ' ^ ' 



(44) 



Using the upper bound dTIT l. we obtain a more explicit form 
Pz,<{^^" (45) 

VI. Dual Basis Reduction 

In this Section, we shall derive upper bounds on the 
proximity factors when the dual rather than the primal basis 
is reduced. 



A. Dual LLL Reduction 
1) SIC: 

Theorem 5: For SIC with dual LLL reduction, the proxim- 
ity factors are bounded by 

P.,sic < 13"'. (46) 
Proof: A scrutiny into the derivation of psic with primal- 
basis reduction reveals that the following condition is crucial: 



|A*i,«-i| < 1/2, l<i<n. 



(47) 



A basis satisfies the Lovasz condition and ( |47l ) is called an 
effectively LLL-reduced basis [41]. Effective LLL reduction 
produces a basis with the same set of Gram-Schmidt vectors. 
Accordingly, with SIC, it yields the same output as the 
standard LLL reduction. Moreover, if a basis is effectively 



g 



LLL-reduced, so is its dual basis [41]. This is because the 
inverse of the coefficient matrix fi admits the form [43] 



1 

X 




1 

-M3,2 









/^n,n— 1 1 



and the Lovasz condition can be shown to be satisfied for the 
dual basis. 

Although other off-diagonal elements may have absolute 
values larger than 1/2, it does not really cause a problem, 
since we still have 

XHL) 



Pi, SIC 



sup 



B-GBlll 



blip 



(48) 



< 13' 



Note that this is the same as ( l33T l for primal LLL reduction. 
Accordingly, we expect similar performance for primal and 
dual LLL reductions. 

2) ZF: 

Theorem 6: For ZF with dual LLL reduction, the proximity 
factors are bounded by 



/3 P'' 

P^,ZF < 1 + T 



1 



i-1 



(49) 



4 /3- 1 , 

Proof: The derivation of the bound on p^ zF is analogous 
to that for primal LLL reduction. We start by 



Pi,ZF < sup 



XHL) 



which holds for any bases. Incorporating the lower bound 
in Appendix HID we deduce 



Pi,ZF < sup A (L) , 

B-GBlll 1 4 



(50) 



Besides, the primal basis is effectively LLL-reduced when the 
dual basis is LLL-reduced. Thus, ||b,||2 > ^-(»-i)||bi||2. We 
obtain 



P.ZF< sup ^(l + ig/3^)/3-i 



B-gBli 



IbilP 



(51) 



which leads to ( |49l ). ■ 
Since the right-hand side of ( l49b is an increasing function 
of i for /3 > 4/3, we have 



PZF < 



(52) 



We emphasize that the worst case bound (|52| | is the same as 
dual LLL-SIC and is close to that for SIC with primal LLL 
reduction. 



B. Dual KZ Reduction 

1) SIC: It is shown in [31] that if a reversed dual basis is 
KZ reduced, then 7i||l5i|| > A(L). Accordingly, we have 

Theorem 7: For SIC with dual KZ reduction, the proximity 
factors are bounded by 



(53) 



Although the Hermite constant is very likely to be an 
increasing function, it has never been proved [31]. Hence, we 
bound the overall proximity factor for SIC by 



Psic < niax 7, 

l<t<n 



(54) 



Since 7„ < 2n/3, we have psic < (2n/3)2 < n^. A better 
bound can be obtained by employing Blichfeldt's bound on 
the Hermite constant: 



Psic < 



(55) 



We claim that is never greater than the bound on the 
KZ constant ( l40l l. We prove this by induction. When i — 1, 
^1=7^ = 1, and the claim is true. Suppose it is true when 

k 

k = i we have 



i — 1, from which we deduce 7i_i < ■•■72- When 



7j 



l/(i-l) l/(i-2) 

lili '7,-1 ■•■72 



< 



7i 



(i_2)/(,-l) 



l/(i-l) 



By Mordell's inequality 7*"^ < ^IZi [32], this is not greater 
than one. Thus the claim is true for fc = i as well. 

Therefore, reducing the reversed dual basis again has a 
smaller bound on pi^sic than reducing the primal basis. 

2) ZF: Substituting 7j||bj|| > A(L) for dual ICZ reduction 
[31] into ( l50b , we arrive at 

Theorem 8: For ZF with dual KZ reduction, the proximity 
factors are bounded by 



2 X ^ 2 

P,,ZF < 7z + 4 2^ I3 ■ 



(56) 



We claim that the right-hand side of ( |56] | decreases with 
i. To see this, it is sufficient to show 7I > |7f+i. We 
apply Mordell's inequality together with the inequality 7„ < 
(2/a/3)"~\ yielding 

<li ' <lt- 2/V3. 

Thus the claim is proven. 

Accordingly, the right-hand side of ( [56] ) attains the maxi- 
mum when i = I, and 



1 " 

PZF< I + -5I7 



4^ 'J- 

J=2 



Using the bound 7^ < 2j/3 for j > 2, we can obtain 

8 1 n{n + l){2n+l) 
P^'-9 + 9 6 • 



(57) 



(58) 



The right side of dSSl l is never larger than n^, and will be 
dominated by n^/27 as n goes large. 
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Fig. 2. Upper bounds on the proximity factors pzF and psic for KZ reduction 
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Fig. 3. Upper bounds on the proximity factors pzF for LLL reduction with 
<5 = 1. 

VII. Numerical Results and Discussion 

To visualize the behaviors of proximity factors, we plot the 
best upper bounds in Table U In Fig. |2] we show the upper 
bounds on the proximity factors for KZ reduction and for 
LLL reduction with best performance (i.e., S = 1). For KZ 
reduction, we employ (l44l i and ( |40] i in conjunction with the 
bound (fT2] l on the Hermite constant and the exact value (fl4] i 
for n < 8. It is clear that the bounds on proximity factors for 
KZ reduction are smaller than those for LLL reduction. This 
is expected since KZ reduction is a stronger notion of lattice 
reduction. 

Fig. |3] shows the upper bounds on pzF with primal and dual 
LLL reduction. Obviously, the bound for reducing the dual 
basis is smaller for the purpose of ZF. 

In Fig. m we show the upper bounds on the proximity 
factors for KZ reduction of the primal as well as dual bases. 
Obviously, for ZF, the bound for reducing the dual basis 
is much smaller. Meanwhile, we can see that, for SIC, the 
gain due to dual KZ reduction is not significant. The reason 
is that as far as the Gram-Schmidt vectors are concerned. 




Fig. 4. Upper bounds on the proximity factors for KZ reduction of the primal 
and dual bases. 

the primal and dual KZ reduction are in fact not too much 
different, as also recognized in [10]. Because the product 
nr=i = dcti is invariant under lattice reduction, 

choosing short Gram-Schmidt vectors in the beginning will 
force long Gram-Schmidt vectors in the end, and vice versa. 

Compared with primal basis reduction, the dual-basis refor- 
mulation is more natural in the following senses. 

For ZF, we have B^y = x + Btn. Then, the noise variance 
associated with the i-th output is proportional to ||b*|p. 
Obviously, it makes sense to minimize ||b*|p. 

Most existing reduction notions aim to find short vectors one 
after another; hence when applied to the dual basis, they can 
be viewed as various greedy heuristics of finding the optimal 
bases for decoding purposes. In particular, the dual Minkowski 
reduction can be viewed as a greedy algorithm to approximate 
the ZF criterion, while the dual KZ reduction as a greedy 
algorithm to approximate the SIC criterion, since they will 
successively find the shortest vector and the shortest Gram- 
Schmidt vector for the dual basis, respectively. 

To verify the benefit of dual reduction for LLL-ZF, we 
simulate the BER performance of an 8 x 8 MIMO system 
with i.i.d. complex standard normal channel coefficients. The 
complex basis matrix H is converted into its real equivalent 
by 

3fi(H) -3(H) 
5(H) 3fi(H) 

and then B is reduced. The signal constellation at each 
antenna is 64QAM with Gray mapping. With such a signal 
model, the SNR at each receive antenna is defined as SNR — 
nTExe64QAM[x'^]/o''^, where ut is the number of transmit 
antennas. Fig. |5] shows the simulated BER of ZF with primal 
LLL reduction and dual LLL reduction. When the decoded 
lattice point falls outside of the signal boundary, we simply 
round it componentwise back to the 64QAM alphabet. It is 
seen that the latter exhibits about 3 dB gain at the BER 
of lO^'"^. Lattice decoding ignoring the boundary is also 
simulated, whose performance is about 1 .5 dB worse than ML 
decoding at the BER of 10" "'. 

A similar amount of gain is observed for ZF with primal 
and dual KZ reduction. In the simulation of SIC, though, only 
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Fig. 5. BER of ZF with LLL reduction witli 5 = 3/4 for 64QAM over an 
8x8 complex-valued MIMO fading cliannel. 

a small difference in the BER is observed between primal 
and dual reduction. This is not surprising given their clos^ 
proximity factors (cf. Table 

We assess the tightness of the bounds by means of numerics 
experimentation. Each time, a basis matrix B is random! 
generated and reduced, and then the minimum distance o 
the decision region (for ZF and SIC, respectively) as we] 
as the shortest vector is found. For each value of n, th 
empirical proximity factor is obtained as the maximum over ai 
ensemble of 10000 i.i.d. Gaussian matrices B. While there i 
no guarantee that this maximum reaches the worst-case bounc 
it should be a reasonable indicator of the theoretic proximit 
factor In particular, it can serve as a experimental lower bouni 
on the theoretic proximity factor Fig. |6] shows the results fo 
(primal-basis) LLL reduction with 6 = 3/4. The numerics 
results (in dB) still grow linearly, but at a lower slope. Fig 
|6] also shows the real SNR gap to ML decoding observe^ 
in computer simulation for n — 8, 12, 16. To estimate th 
real SNR gap, the BER performance is simulated, and curve 
like those in Fig. |5] are obtained. It can be seen that the reai 
SNR gap is even smaller. This behavior is consistent with 
the common belief that in practice LLL reduction performs 
better than the theoretic upper bounds. Fig. [7] demonstrates 
the numerical results for KZ reduction. The similar trend can 
be seen. 

In summary, we have shown that lattice reduction-aided 
decoding is in proximity to (infinite) lattice decoding. We have 
derived analytic bounds on proximity factors that quantify 
the worst-case gap. The same diversity order as that of 
lattice decoding in MIMO fading channels comes as a direct 
consequence. According to the analysis, dual lattice reduction 
could give smaller upper bounds, especially in ZF where 
performance gain has been observed in computer simulation. 

Finally, we point out several open issues of lattice reduction- 
aided decoding. 

Firstly, there is room to tighten the bounds derived in this 
paper In Table U the bounds are tight for Gauss reduction and 
for KZ-SIC with primal reduction. The bound is very likely 
to be tight for KZ-SIC with dual reduction; it will be tight as 
long as the Hermite constant is an increasing function which is 
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Fig. 6. Comparison of the theoretic upper bounds and numerical results of 
the proximity factors for LLL reduction (5 = 3/4). 
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Fig. 7. Comparison of the theoretic upper bounds and numerical results of 
the proximity factors for KZ reduction. 



very likely to be true. The bound is quite good for KZ-ZF with 
dual reduction (cf. Fig. |4|. However, the bounds are not tight 
for LLL reduction and KZ-ZF with primal reduction. For LLL 
reduction, we have applied the trivial bound A^(L)/||b,:|p < 1 
or A'^(L)/||bi|p < 1. But this is Hkely to loosen the bound, 
since /?-("-!) < A2(L)/||b,||2 and ^-(""i) < X^{L)/\\hi\\^ 
for LLL reduction [37]. 

Secondly, we emphasize that the worst-case bounds should 
be carefully interpreted. The average-case performance may 
be a more meaningful measure if the basis B is random. 
A smaller proximity factor does not necessarily guarantee 
better average performance. For example, KZ reduction must 
have smaller approximation factors than LLL reduction, but 
their BER performance appears to be very close in MIMO 
fading channels [15]. Hence an average-case analysis will 
complement the worse-case analysis. In simulations of LLL 
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reduction, we observed that the SNR gap (in dB) indeed 
widens Hnearly with the dimension, but at a lower slope. This 
behavior is consistent with the common belief that in practice 
LLL reduction performs better than the theoretic upper bounds. 
Recently, Nguyen and Stehle showed that the average behavior 
of LLL reduction is still exponential, but at a slower rate [44] . 

Thirdly, the analysis of dual reduction naturally raises the 
issue of simultaneously reducing the primal and dual bases. 
Methods of simultaneous reduction exist, notably those of 
Seysen [45] and Howgrave-Graham [46]. 

Appendix I 
The Angle 6i of a Basis 

We derive a formula for angel 0i of a basis B, which is used 
to compute the distance of ZF. Following Babai [13], let a = 
Sj^^i ckjbj (aj e M for j ^ i) be an arbitrary vector on the 
hyperplane spanned by vectors bi, -- , bi_i, bi_(-i, • • • ,b„. 
The vector z = a — b^ will attain its minimum length if and 
only if it is perpendicular to the hyperplane. We express z in 
terms of the Gram-Schmidt vectors as z = X]j=i''j^'j - 
ai = —1. Then we have the expression [37] 

n 



We can see 



l^sin^i 



min^rlllbjl 



(59) 



where the minimum is taken over the coefficients . It is not 
difficult to see that Vj — for j < i if z is orthogonal to the 
hyperplane. Accordingly, we may exclude the j <i terms, to 
yield 



P sin^ I 



min^rlllbjl 



(60) 



This was also done by Babai [13]. Here we have explicitly 
shown that excluding the j < i terms does not weaken the 
bound. 



For notational convenience, define a 



r = [n,--- ,rn]^, M be {n - i + I) x {n - i + 1) 
bottom-right submatrix of /x, A be the diagonal matrix 



diag(||bj 



••• ,||b„|P), and A = MAM^. We 



have the expressions r ~ M a and 



r-^Ar = Aa. 



We want to find the minimum of cy.^Aa subject to the 
constraint = —1. This can be achieved by using the 
Lagrangian multiplier method. Define the objective function 

/ = a^Aa + s(a,; + 1). 

Nulling the partial derivative of / with respect to a, we have 

2Aa + sei = 

where the unit vector ei has all zero elements except that the 
first is one. From this we obtain a = — |A^^ei. Furthermore, 



since we know ai = 
2/(A-i)i,i. Therefore, 



^(A = —1, we have 



and from i59[ we deduce 



sm 



|b,|P(A-i)i,i- 



(62) 



We have expressed 9i in terms of bi and the Gram-Schmidt 
orthogonalization of B . Given B, the angle 9i can easily be 
calculated. 

Appendix II 
Proof of Lemma[T] 

When deriving a lower bound on di, Babai loosened the 
bound in several steps. It is natural to ask if his bound can 
be improved. In Appendix |I] we have seen that excluding the 
j < i terms from (|59] l does not weaken the bound. Babai 
showed [13] 



E 

3=t 



r^||b,f >(2/9r 



(63) 



Here we derive a better lower bound by using a different 
approach. Basically, we examine the maximum of the first 
element of matrix A^^ = M^-'^A^^M"^ for a size-reduced 
(lower- triangular) matrix M. To do so, we need the following 
lemma: 

Lemma 2: The absolute value of the (i,j)-th entry of the 
inverse M^^ of an / x / size-reduced matrix M is not greater 
than 

1 /3\'~^ 

, l<j<i<l, (64) 



and this is achieved when all off-diagonal elements of M are 
equal to —1/2. 

Proof: We prove it by induction on the dimension I. Note 
that M^^ is lower triangular, with unit diagonal elements. 
Lemma |2] is obviously true when I — 2, since the off- 



diagonal element of M is — m2,i, and the maximum 1/2 is 



achieved when m2,i = —1/2. 

Suppose Lemma |2] is true for I — k — 1. When I = k, we 
partition the matrix M into the form 



M 



Using the formula for the inverse of a partitioned matrix [47], 
M^^ can be expressed as 



M 



fe-i 



Here, the {i,j)-th element of MjT^j^ is given by ( |64] | for 1 < 
j < i < k — 1. Since they are all positive, each element of 
—h'^'M.^^-^ is maximized when h is an all —1/2 vector. 
Consider the first element of — h^M^T^j^, given by 



^'l /3\^ 1 /3\'-' 
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which verifies ( |64] l. The other elements of — h^MjT^j^ can be 
verified in the same way. ■ 
Denote by p the first column of M^^. Then we have 



(A-i)i.i=P^A-^P 



< lib,. 



' f^V uu 11-2 (65) 



Note that the only condition for (1651 1 is that the basis is size- 
reduced, i.e., luijl < 1/2 for i < j. The choice of the 
parameter d would have no effect on this condition. 

For an LLL-reduced basis, ||bi+j||^ > /3^^ ||bi|p. Hence, 



< 



j=i ^ 

P /9/3 



2 .gx 2, 



9^-4 V 4 
and correspondingly, 



> 



9/3- 



9^ 

4 vT 



9/3 



+ 



9/3-4 



(67) 

When /3 = 2, the new bound is asymptotically tighter by a 
factor of 7 than Babai's lower bound ( |67] |. 

Substituting (ISTl i and (|66] | into (|62] |. we obtain Lemma [T] 
Note that we have also incorporated the better estimate (ISTT i 
of the length of b;. 

Appendix III 
Lower Bound for Dual Size Reduction 



We derive the counterparts of (l65T l and (l67b when the 
reversed dual basis is size-reduced. The notation in Appendix 
lUis followed. The difference is that, by the following lemma, 
all off-diagonal elements of M^^ lie in interval [—1/2, 1/2]. 

Lemma 3: If the dual basis is size-reduced, then the off- 
diagonal elements of fi~^ lie in the interval [—1/2, 1/2]. 

Proof: By definition, the off-diagonal elements of fi* lie 
in [—1/2,1/2] if the reversed dual basis B* is size-reduced. 
By Proposition [T] fi^ — J(/x*)^J. This proves Lemma[3] ■ 

Consequently, 



(A-i)i,i=p^A-ip 



< lib,. 



-J n — i 



(68) 



and 



> lib. 



^ n—i 



(69) 



3=1 



In contrast, when the primal basis is size-reduced, the off- 
diagonal elements of can only be bounded by ( |64| |. 
which can be much larger than 1/2. This analysis clearly 
shows that it is the dual basis, rather than the primal basis, 
that should be reduced for the purpose of ZF. 
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